Deep Learning Approach to Key Frame Detection in Human Action Videos

A key frame is a representative frame which includes the whole facts of the video collection. It is used for indexing, classification, evaluation, and retrieval of video. The existing algorithms generate relevant key frames, but additionally, they generate a few redundant key frames. A number of them are not capable of constituting the entire shot. In this chapter, an effective algorithm primarily based on the fusion of deep features and histogram has been proposed to overcome these issues. It extracts the maximum relevant key frames by way of eliminating the vagueness of the choice of key frames. It can be applied parallel and concurrently to the video sequence, which results in the reduction of computational and time complexity. The performance of this algorithm indicates its effectiveness in terms of relevant key frame extraction from videos

Pedestrian Detection and Tracking in Video Surveillance System: Issues, Comprehensive Review, and Challenges

Pedestrian detection and monitoring in a surveillance system are critical for numerous utility areas which encompass unusual event detection, human gait, congestion or crowded vicinity evaluation, gender classification, fall detection in elderly humans, etc. Researchers’ primary focus is to develop surveillance system that can work in a dynamic environment, but there are major issues and challenges involved in designing such systems. These challenges occur at three different levels of pedestrian detection, viz. video acquisition, human detection, and its tracking. The challenges in acquiring video are, viz. illumination variation, abrupt motion, complex background, shadows, object deformation, etc. Human detection and tracking challenges are varied poses, occlusion, crowd density area tracking, etc. These results in lower recognition rate. A brief summary of surveillance system along with comparisons of pedestrian detection and tracking technique in video surveillance is presented in this chapter. The publicly available pedestrian benchmark databases as well as the future research directions on pedestrian detection have also been discussed

Robust pedestrian detection and path prediction using mmproved YOLOv5

In vision-based surveillance systems, pedestrian recognition and path prediction are critical concerns. Advanced computer vision applications, on the other hand, confront numerous challenges due to differences in pedestrian postures and scales, backdrops, and occlusion. To tackle these challenges, we present a YOLOv5-based deep learning-based pedestrian recognition and path prediction method. The updated YOLOv5 model was first used to detect pedestrians of various sizes and proportions. The proposed path prediction method is then used to estimate the pedestrian's path based on motion data. The suggested method deals with partial occlusion circumstances to reduce object occlusion-induced progression and loss, and links recognition results with motion attributes. After then, the path prediction algorithm uses motion and directional data to estimate the pedestrian movement's direction. The proposed method outperforms the existing methods, according to the results of the experiments. Finally, we come to a conclusion and look into future study

Neural Network Approach to Iris Recognition in Noisy Environment

AbstractIris recognition is a challenging problem in the noisy environment. Our primary focus is to develop the reliable iris recognition system that can work in a noisy imaging environment and to increase the iris recognition rate on CASIA and MMUiris datasets. This research paper proposes two algorithms, first, a novel method for removing noise from the iris image and second, a texture feature extraction method using a combined approach of Local Binary Pattern (LBP) and Gray Level Co-occurrence Matrix (GLCM). Our proposed approach give highest recognition rate of 96.5% and low error rate and requires less execution time

Robust Pedestrian Detection and Path Prediction using Improved YOLOv5

In vision-based surveillance systems, pedestrian recognition and path prediction are critical concerns. Advanced computer vision applications, on the other hand, confront numerous challengesdue to differences in pedestrian postures and scales, backdrops, and occlusion. To tackle these challenges, we present a YOLOv5-based deep learning-based pedestrian recognition and path prediction method. The updated YOLOv5 model was first used to detect pedestrians of various sizes and proportions. The proposed path prediction method is then used to estimate the pedestrian's path based on motion data. The suggested method deals with partial occlusion circumstances to reduce object occlusion-induced progression and loss, and links recognition results with motion attributes. After then, the path prediction algorithm uses motion and directional data to estimate the pedestrian movement's direction. The proposed method outperforms the existing methods, according to the results of the experiments. Finally, we come to a conclusion and look into future study

Scale Invariant Mask R-CNN for Pedestrian Detection

Pedestrian detection is a challenging and active research area in computer vision. Recognizing pedestrians helps in various utility applications such as event detection in overcrowded areas, gender, and gait classification, etc. In this domain, the most recent research is based on instance segmentation using Mask R-CNN. Most of the pedestrian detection method uses a feature of different body portions for identifying a person. This feature-based approach is not efficient enough to differentiate pedestrians in real-time, where the background changing. In this paper, a combined approach of scale-invariant feature map generation for detecting a small pedestrian and Mask R-CNN has been proposed for multiple pedestrian detection to overcome this drawback. The new database was created by recording the behavior of the student at the prominent places of the engineering institute. This database is comparatively new for pedestrian detection in the academic environment. The proposed Scale-invariant Mask R-CNN has been tested on the newly created database and has been compared with the Caltech [1], INRIA [2], MS COCO [3], ETH [4], and KITTI [5] database. The experimental result shows significant performance improvement in pedestrian detection as compared to the existing approaches of pedestrian detection and instance segmentation. Finally, we conclude and investigate the directions for future research

Scale Invariant Mask R-CNN for Pedestrian Detection

Pedestrian detection is a challenging and active research area in computer vision. Recognizing pedestrianshelps in various utility applications such as event detection in overcrowded areas, gender, and gaitclassification, etc. In this domain, the most recent research is based on instance segmentation using MaskR-CNN. Most of the pedestrian detection method uses a feature of different body portions for identifying aperson. This feature-based approach is not efficient enough to differentiate pedestrians in real-time, wherethe background changing. In this paper, a combined approach of scale-invariant feature map generationfor detecting a small pedestrian and Mask R-CNN has been proposed for multiple pedestrian detection toovercome this drawback. The new database was created by recording the behavior of the student at theprominent places of the engineering institute. This database is comparatively new for pedestrian detectionin the academic environment. The proposed Scale-invariant Mask R-CNN has been tested on the newlycreated database and has been compared with the Caltech [1], INRIA [2], MS COCO [3], ETH [4], andKITTI [5] database. The experimental result shows significant performance improvement in pedestrian detection as compared to the existing approaches of pedestrian detection and instance segmentation. Finally, we conclude and investigate the directions for future research